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Abstract 

We provide a systematic treatment of self-averaging identities for 
various spin systems. The method is quite general, basically not 
relying on the nature of the model, and as a special case recovers 
the Ghirlanda-Guerra and Aizcnman-Contucci identities, which are 
therefore proven, together with their extension, to be valid in a vaste 
class of spin models. We use the dilute spin glass as a guiding ex- 
ample. 

Key words and phrases: spin glasses, diluted spin glasses, Ghirlanda-Guerra, 
self-averaging. 

1 Introduction 

Despite many years of intense work, and the much awaited proof of the va- 
lidity of the Parisi ansatz for the free-energy of the Sherrington-Kirkpatrick 
(SK) and related models, the mathematical comprehension of thermody- 
namics of mean field spin glasses remains largely incomplete. We know 
from theoretical physics that in fully connected models, all the properites 
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of the low temperature spin glass phase can be encoded in the probability 
distribution of the overlap between two different copies of the system. The 
analysis of Parisi et al. predicts an ultrametric organization of the phases 
(see [12] and references therein). So far the rigorous proof (or disproof) of 
ultrametricity, and, more in general, the analysis of the structure of Gibbs 
measures at low temperature, turned out to be a very difficult task. A 
step in this direction was performed by Ghirlanda and Guerra in [S] . They 
found a simple and elegant way, based on the self-averaging of the internal 
energy, to prove a remarkable property of the overlaps. Given s replicas, 
the Gibbs measure must be such that when one adds a further replica this is 
either identical to one these, or statistically independent of them; each case 
occurring with the same probability. More generally, various constraints 
on the distribution of the different overlaps have been found in the same 
spirit ([Hm]). Such features have found several apphcations ([inill]) in 
the rigorous analysis of spin glass models. For example, the property of 
non-negativity of the overlap, which in some models plays a role in turn- 
ing the cavity free-energy into a rigorous lower bound, turns out to be a 
consequence of the Ghirlanda- Guerra self-averaging identities (U6j). In the 
same way these identity have a role in the rigorous analysis of spin glasses 
close to the critical temperature ([I]). 

In more general spin-glass systems, like finite dimensional systems or 
spin systems on random graphs, the statistics of the overlap are not enough 
to fully characterize the low temperature spin glass phase. For instance, 
in diluted models the statistics of the local cavity fields, or equivalently of 
all the multi-overlaps, is necessary to describe the low temperature ther- 
modynamic properties. In this paper, we analyse two families of identities 
for the local fields and multi-overlap distributions that are a consequence 
of self-averaging relations. We will see that one of the two families is a 
consequence of the self-averaging with respect to the Gibbs measure or, 
equivalently, of stochastic stability, as the two phenomena turn out to be 
equivalent. The other family of identities is instead a consequence of self- 
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averaging with respect to the global measure (quenched after Gibbs). Our 
conclusions will not rely much on the specific form of the Hamiltonian of 
the model. We will however use the example of spin models on sparse 
random graphs (dilute spin glass models), where we expect that our re- 
sults could provide hints for progresses in the mathematical analysis of the 
low temperature phases. Diluted mean field spin glasses have, in recent 
time, attracted a lot of attention in statistical physics, due to their intrin- 
sic interest of spin glasses where each spin interacts with a finite number 
of variables, but more importantly because fondamental problems in com- 
puter science, such as the random K-SAT and graph coloring, the random 
X-OR-SAT, tree reconstruction [llj and others, admit a formulation in 
terms of spin glass systems on random graphs. The cavity approach to 
these problems has led in many cases to results believed to be exact, albeit 
for the moment several rigorous proofs are still lacking. 

Some of the identities that we will discuss appeared already in [7] to 
discuss free energy bounds in diluted models with non-Poissonian connec- 
tivity. Here we re-derive with different methods this family of identities, 
and we exhibit a second family of new identities. 

2 The notations 

We will use the stereotypical dilute spin glass model, the Viana-Bray (VB), 
to introduce here the notations we need, and to derive our results in the 
next two sections. 

Notations: a, (3 are non-negative real numbers (degree of connectivity 
and inverse temperature respectively); is a Poisson random variable of 
mean ^; {«!/}, {jjy}, etc. are independent identically distributed random 
variables, uniformly distributed over the points {l,...,Af}; { Jj^}, J, etc. 
are independent identically distributed random variables, with symmetric 
distribution; is the set of all the quenched random variables above; the 
map (7 : i ^ (Ti, i £ {1, . . . , is a spin configuration from the configura- 
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tion space E = {—1, 1}^; is the Poisson measure of mean E is an 

average over all (or some of) the quenched variables; uj or simply uj is the 
Bolztmann-Gibbs average explicitly written below; or simply Q are a 
product of the needed number of independent identical copies (replicas) of 
ojj; (•) will indicate the composition of an E-type average over quenched 
variables and the Boltzmann-Gibbs average over the spin variables (see be- 
low). We will often drop the dependance on some variables or indices or 
slightly change notations to lighten the expressions, when there is no am- 
biguity. As a main example, consider the Hamiltonian of the Viana-Bray 
model, defined as 

PcJV 

We will limit to the case J — ±1, without loss of generality [10]. We 
follow the usual basic definitions and notations of thermodynamics for the 
partition function Zn, the pressure pn, the free energy per site /n and its 
thermodynamic limit /, so to have in general 

ZN{(3,a) = Z{HN;(3,a) = exp(-/?gjv(g, a)) , 

Pn{P,oi) = -f3fN{(3,a) = ^ElnZ7v(/3, a) , /(/3, a) = lim /Ar(/3, a) . 
The Boltzmann-Gibbs average of an observable O : E ^ K is 

w(0) = Zjv(/3,a)-^^0(a)exp(-/3i/jv(CT,«)) , 

E denotes the average with respect to the quenched variables, and (•) = 
Ea;(-) is the global average. 

The multi-overlaps qi...m '■ — + [—1,1], where we use the notation 
E" = E(i)x - --xE^"), among the "replicas" E^''^) 3 cr^'^i), . . . , E^''") 3 cr^''") 
is defined by 

('•i) ('".>) 
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but sometimes we will just write g„; qi can be identified with the magne- 
tization m 

1 ^ 



i=l 

Dealing with binary spins, we will not be using powers of the spins, so we 
will often drop the brackets () in the replica index for the spins, so that 
af = cr|*'' will mean the «-th spin from the replica s, S'^'^^ not the s-th 
power of (Ji. Notice 

ELj^"{a,_) - (gi...2„) , ]Ew(a,0 = Eu;{m) = (m) . (1) 



3 Stochastic Stability and self-averaging of 
the Gibbs measure 

In the study of finite connectivity models it emerged that in a suitable 
propability space it is possible to formulate an exact variational principle for 
the computation of the free energy. This was obtained with the introduction 
of Random Multi-Overlap Structures (RaMOSt). We refer to [6] for details. 
The ROSt approach is based on the use of generic random weights to 
average the "cavity" part and the relative "internal correction" in the free 
energy (these are the numerator and the denominator of the trial free energy 
Gn introduced in See [B] for details). Here we are not interested in 
a detailed discussion of the RaMOSt approach, but we study the effect of 
a perturbation to the measure of our model, which docs not need to be 
the Gibbs measure. That is why introduce this more general weighting 
scheme, although the reader may keep in mind the Gibbs measure as a 
guiding example. 

3.1 Random Multi-Overlap Structures 

The proper framework for the calculation of the free energy per spin is 
that of the Random Multi-Overlap Structures (RaMOSt, see [6] for more 
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details). 



Definition 1 Given a probability space {fl, fj.{duj)} , a Random Multi- 
Overlap Structure TZ is a triple (E, {q2n},£,) where 

• T, is a discrete space; 

• ^ : S ^ is a system of random weights, such that '^^^■^ oo 
fi-almost surely; 

• q2n ■ — !■ M, n G N zs a positive semi-definite Multi-Overlap Kernel 
( equal to 1 on the diagonal of S^" , so that by Schwartz inequality 

A RaMOSt needs to be equipped with N independent copies of a random 
field {hl^{a] and with another random field i?-y(a; J) such that 

^Eln^C^exp(-/3/i;) = 2 ^ tanh2"(/3)(l - (g^™)) , (2) 

±mnY,i,eM-fiH,) = ^ i- tanh^" (/?)(! _ . (3) 

These two fields are employed in the definition of the trial pressure 

G.(7^;/5) = lEln5^^il^^£^I^Sl^ . (4) 
N E,^7exp(-/3i?,) 

The reason why this is the proper framework for the calculation of the free 
energy is explained by the next [6] 

Theorem 1 (Extended Variational Principle) Taking the infimum for 
each N separately of the trial function Gat (7?.;/?) over the space of all 
RaMOSt's, the resulting sequence tends to the limiting pressure —I3f{j3) 
of the VB model as N tends to infinity: 

-/?/(/3)- lim iniGNin-p) . 

N—*oo TZ 
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A RaMOSt n is said to be optimal if G{Tl] (3) = -Pf{P) V (i. We will 
denote by Q. the measure associated to the RaMOSt weights ^ as well. 

The Boltzmann RaMOSt is optimal, and constructed by thinking of 
a reservoir of M spins t 

M 

I] = {-l,ir 3r , ^.=exp(-/3i/M(r)) , = - J] • • • rf 

fc=i 

with 

j/=i i/=i 
and J, J all independent copies of J. 

Let Ci — 2 cosh(/3/i*). It is possible to show [S] that optimal RaMOSt's 
enjoy the same factorization property enjoyed by the Boltzmann RaMOSt 
and described in the next [6] 

Theorem 2 (Factorization of optimal RaMOSt's) With the possible 
exception of a zero measure set of values of the degree of connectivity, the 
following Cesaro limit is linear in N and a 

C limEln VLm{ci ■ ■ ■ cn exp[-/3if(a)]} = N(-f3f + aA) + aA , 

M 

where 

oo 

^ = E ^Etanh2"(^J)(l - {ql)) . (5) 

n— 1 

This factorization property is called invariance with respect to the cavity 
step, or Quasi-Stationarity, and it is found in the hierarchical Parisi ansatz 
as well. When a is zero, the theorem above states the factorization of the 
cavity fields, and it is possible to show that from this property one can 
deduce the family of identities we will discuss in the next subsection [3]. 
When one removes instead the cavity terms ci , . . . , c^r from the previous 
theorem, the statement becomes what is usually referred to as Stochastic 
Stability. We will show that the latter too implies the same family of 
identities. We will have in mind the case of a small perturbation of our 
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spin system, but what we find holds for more general RaMOSt's, provided 
the previous theorem holds, that is for Quasi-Stationary RaMOSt's. 

3.2 The first family of identities 

We will now prove a lemma that expresses the stability of the Gibbs mea- 
sure of our model against a macroscopic but small stochastic perturbation. 
In different terms, the lemma expresses the linear response of the free en- 
ergy to the connectivity shift the perturbation consists of. The lemma 
we are about to prove will be used to show that from stochastic stability 
one can deduce a certain self-averaging which in turn imposes a family of 
constraints on the distribution of the overlaps. 

Lemma 1 Let Cl , (•) be the usual Gibbs and quenched Gibbs expectations 
at inverse temperature (3, associated with the Hamiltonian HN{a;a;J'). 
Then, with the possible exception of a zero measure set of values of the 
degree of connectivity, 

^lim^Elnl^ exp U' ^ J>i'^a,. j = J] ^ i^nh^^{(3'){l-{ql^)) , (6) 

^ i/=l ^ n=l 

where the random variables Pa',{Jl}, {iu}j{jl} ft^^e independent copies of 
the analogous random variables in the Hamiltonian in contained in SI. 

Notice that, in distribution 

PcN Pa' P(o. + a'/N)N 

lf=l i/=l u=l 

where {J"} are independent copies of J with probability aN/{aN + a') 
and independent copies of J(3' /(3 with probability a'/{aN + a'). In the 
right hand side above, the quenched random variables will be collectively 
denoted by J'". Notice also that the sum of Poisson random variables is 
a Poisson random variable with mean equal to the sum of the means, and 
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A, ^ E In n exp ( P' J2 J>^l <^y. ) = E In , (8) 



hence we can write 

J'rr,, n„ \ = F. In - 

where we defined, for t e [0, 1], 

at = a + a'-^ (9) 
so that ttf — > a V t as oo. 

Proof. Let us compute the i-derivative of At-, as defined in ([5]) 



d_ 

dt 



= E ^ — 7ra't(m) In ^ exp f /3' ^ j 

m— 1 cr ^ I/— 1 ^ 



Using the following elementary property of the Poisson measure 

^7rt<;(m) = C(7rtc("i-l)-7rtcM) (10) 

we get 

^ oo m 

—At = a'E ^ [TTa/t (m - 1) - 7rQ/t(m)] In ^exp(/3' ^ J^CTi'^CTjv) 
m=0 iy— 1 

= a'E In ^ exp (/J'J'cTi^crj/^) exp (/?' ^ J'^Oii^uy^') 

a v—l 

-a'Eln^exp(^' ^ ) 
= tt'ElnJlt exp(/3'j'(Ti^^f7j;^) , 

where we included the i-dependent weights in the average f^t . Now use the 
following identity 

exp(/3' J'cr.cTj) = cosh(/3' J') + a.Uj sinh(/3'J') 

to get 



d 
'dt 



At = a'E In a [cosh(/3' J') (1 +tanh(/3'J')cri;, CTj-;^)] 



It is clear that 

SO we now expand the logarithm in power series and see that, in the limit 
of large as at ^ a the result does not depend on t, everywhere the 
expectation (■)t is continuous as a function of the parameter t (or equiv- 
alently as a function of the degree of connectivity). From the comments 
that preceded the current proof, formalized in ([T])-©-®, this is the same 
as assuming that is regular as a function of a, because J" — > J in the 
sense that in the large N limit J" can only take the usual values ±1 since 
the probability of being ±(3' / (3 becomes zero. Therefore integrating over t 
from to 1 is the same as multiplying by 1. Due to the symmetric distri- 
bution of J, the expansion of the logarithm yields the right hand side of 
([6]), where the odd powers are missing. □ 
Let us define 

H{a'; J)^J2 J-'^^'^'^J'^ - H{a'/N; J) 

Let us now consider the statement of Lemma [TJ in the case of two indepen- 
dent perturbations (the quenched variables in the perturbations, denoted 
by J{., J^^ are independent one another and independent from those in the 
Hamiltonian of the Boltzmann factor). Then the fundamental theorem of 
calculus can be used twice to extend the statement of the previous lemma 
to 

Elnf^[exp(-/3i7?(al; J[) - P'^H [a'^- j!,))] - {a[ + a'^)A , (11) 

where A again does not depend, in the thermodynamic limit, on 
and incidentally has the same form as the right hand side of ([6]). In the 
equation above, assumed to be taken in the thermodynamic limit, il is the 
Gibbs measure associated with the unperturbed Hamiltonian of the original 
model, and the same holds for the averages appearing in A, just like in the 
previous lemma. Clearly we then have (omitting the dependence on the 
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independent quenched random variables) 

^-?^Elnl7[exp(-/3;if(ai) - /3^if(a^))] = , 

and again in the thermodynamic Umit O does not include any perturbation 
with a'l, (3'i,(32. A simple computation yields 

^-^Elnn[exp(-/?;i?(al) - /3^i?(a^))] = 

= Eln fl[exp{j3[J[ai^aj^ + l3'2J2^i2<^h] 

- E In f2 [exp {l3[J[ai^aj^]9. [exp (/^a J2 (^i-, ] 

Every time a derivative with respect to a pertubing parameter is taken, the 
relative perturbation is added to the weights of the measure fi, but if the 
pertubation is small (like in our case, as explained in the previous lemma) 
it disappears from the measure in the thermodynamic limit. This is true 
for almost all values of the perturbing parameters. Hence we may assume 
that both in the equation above and in the next calculation (i'2 are not 
in the measure O, and we get 

-Elnf][exp(/3i J^cTjiCTji + J20'i2<^j2] 



a(/3;Ji)a(/3^J2) 

= Er!((j,,(7,J - Er!K)0(a,J = , (12) 

at the price of a zero measure set of values of the parameters (which allows 
us to use always the unperturbed expectation fi). The first line of this 
equation gives us the generator of a family of relations that we will obtain 
by means of an expansion in powers of fj'-^^. [32- The second line of the 
equation formulates the self-averaging (with respect to the Gibbs measure) 
implied by the stochastic stability. 

So we proceed starting from the next lemma and the next theorem, 
summarizing what we just discussed. 
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Lemma 2 Let 51' he the Gibbs measure including two independent pertur- 
bations of the form 

with parameters a'^ , , /3i , ^ike in Then, recalling that m is the 

magnetization, the following self-averaging (with respect to the Gibbs mea- 
sure) identity 

lim Ein'im^) - [n'{m)f} = (13) 
holds for almost all values of the two perturbing parameters a[ , a2 ■ 

We will see again that in the first line of equation (fT2|) the expression 
remains zero even without the derivative. In fact the generator of the 
identities we want to prove is expressed in the following 

Theorem 3 In the thermodynamic limit the following holds for almost all 
values of a[ and a'2 : 

E\nn'(exp{(3[J[a,,aj, + /^a Jk»2'^j2)) = (14) 
Elnr2'(exp(/3; J^cTi.crjJ) +Elnf7'(exp(/3^4cr,2crjJ) . 

The relations we will derive are a simple consequence of this theorem, and 
fomalized in the next 

Corollary 1 In the thermodynamic limit, for almost all values of the per- 
turbing parameters a'^ , a'2 we have 

min{r,s} , , 

( ^a+l {2r + 2s-a-iy. , ^2 y _ q w ^ , ^ 

where the subscript a in the global average (•)^ = ^^'a means that a replicas 
are in common among those in Qr and those in q^, so that in particular fla 
is (in a given term) the product measure of only 2r + 2s — a copies of lo' . 
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The "prime" superscript indicates as usual that the measure contains the 
perturbations, which vanish in the thermodynamic hmit but aUows us "al- 
most sure" statements only. 

Proof. The following shorthand will be employed 



Observe that, if we let ^ = 1, 2, 
Now, 

\jiW ^ ln(l + tiVti + t2^2 + ^1*2^^12) + lncosh/3,/{ + lncosh/?J2 

and 

ln(l + tiVli + 12^2 + tit2ni2) = 



The derivatives in (I12p kill the two terms with the hyperbolic cosines, and 
from (jlSp we know that we can replace the derivatives with respect to j3Jg 
with the derivatives with respect to tg^ 5 — 1,2. Notice that the logarithm 
just expanded is zero for ti = and for t2 = 0, therefore as its derivative 
like in (fT^ is zero, the logarithm itself is zero. This is why Theorem [3] 
holds, being just the integral of the second line in IT^ . 
Thanks to ([T]), if we put 



ti = i&-nh{l3[J[) , <2 = tanh(/32 J2) > 



^'{(Ji^cjj^) , VL2 — ^'{(Ti^aj^) , Q12 = fl^ai^aj-^ai^aj^) 



and 




n — I + m — r , n — m = s , n — I = a 
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we get 



min{r,s} 



{r + s-a-iy. 



o+l 



a\{r — a)!(s — a)! 



r,s a=0 



where means that a rcpUcas arc in common among those in and 
those in Qs . Hence the statement of the theorem to be proven 



3.3 Generalization to smooth functions of multi-overlaps 

The fact that in our formulas we always got the square power of the overlaps 
is due to the fact that the Hamiltonian has 2-spin interactions. Everything 
we did so far could then be reproduced in the case of p-spin interactions, 
and we would obtain the same relations just derived, except the overlaps 
would appear in the power p instead of 2. Clearly the perturbation needed 
in this case is a p-spin perturbation too. More in general, we could consider 
a Hamiltonian consisting of the sum (over p) of p-spin Hamiltonians for any 
integer p. Then we could perturb each of the p-spin Hamiltonians with its 
proper small p-spin perturbation, and add all these perturbations to the 
system. Clearly we have to make sure that all the terms in this whole 
Hamiltonian are weighted with sufficiently small weights so to have the 
necessary convergence. More explicitly, the perturbed Hamiltonian is 



is the usual one, and {Ap} are the independent perturbing real parameters. 
It is not surprising then that we can state 

Corollary 2 With the possible exception of a zero measure set in the space 





p 



where l^pp = |5pP = 1, the notation for all the quenched variables 
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of all perturbing parameters, we have 



min{2r,2s} 



(2r + 2s-a-l)! 
a!(2r-a)!(2s-a)! 



E (-) 



a+l 



Again, this corollary can be seen as a consequence of a self-averaging prop- 
erty, namely 

Ef2(o-,i • • • a^Y^CTji • • • o-j- ) - E[f^(crii • • • ct^™ )^{crji ■ ■ ■ crj- )] = . 

Therefore we can replace each overlap by any smooth function of the 
relative replicas in the statement of the corollaries. 

4 Self-averaging of the quenched- Gibbs mea- 
sure 

Roughly speaking, if a convex random function docs not fluctuate much, 
then its derivative does not fluctuate much cither, with the exception of 
bad cases. This is well explained in Proposition 4.3 of [15 and Lemma 
8.10 of [5]. We are not interested in general theorems, in our case the 
convex function we are interested in is the free energy density, and we 
only need to know that it is self-averaging (in the sense that the random 
free energy density does not fluctuate around its quenched expectation, in 
the thermodynamic limit). In the case of finite connectivity random spin 
systems, a detailed proof of this can be found in [1^. The derivative of 
the free energy density (times —/3) with respect to —(3 is the expectation 
of the internal energy density un — Hn/N. Like in [9] and in section 2 of 
[8], we have therefore this further self-averaging 



lim [«) - (ujv)'] = 



which implies (due to Schwartz inequality) 




lim (wj^Vs) = lim {un){4>s) 



(16) 
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for any bounded function (j)s of s replicas, and u)^' is the internal energy 
density in the configuration space of the replica 1. More precisely, let us 
call the spin-configuration space { — 1, 1}^ = S, and consider a bounded 
function (j)s of s replicas, i.e. : S'^ ^ K. The spin-configuration space 
E is equipped with the Gibbs measure lo, and the product space S'' ("the 
space of the replicas") is equipped with the product measure ("replica 
measure") = f7. The quenched variables are the same in each factor of 
the product space, and this means that the measure (•) = EO(-) — Ea;®'*(-) 
on the product space is not a product measure. We will use for simplicity 
f2 for any value of s. So is the free energy in the space which is the first 
factor in the product space S*. Notice that E has the cardinality of the 
continuum in the thermodynamic limit N oo. Apices will denumerate 
replicas for the spins and the Hamiltonian, while they are just regular 
exponents in the case of overlaps, where the replicas are counted or listed 
in the sub-index. 

At this point we want to perturb the Hamiltonian and consider the 
derivative with respect to the perturbing parameter, as we did in the pre- 
vious section: 



1^=1 

in order to obtain an expansion in powers (3' with coefficients which do not 
depend on in the thermodynamic limit. 

We are going to prove, first of all, the following 

Theorem 4 For a given bounded function 4>s of s replicas, the following 
relation constrains the distribution of the 4-overlap 



p'a 



s(5-H)(s-F2) 
3! 



s{s + l) 
2! 



2,s 



l,a,s+l,s+2 



<t>s) 



a 



2,s 2,s 
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The proof is straightforward but long, and it will be splittcd into several 
steps. 

Let us consider the right hand side of Put t = tanh(/3'), qo = 1, 

and let us just indicate the number of replicas in the overlaps, rather than 
denumerating them all. Recall also that pn — —PIn, which here "contains" 
the perturbed Hamiltonian. Let us prove the next 

Lemma 3 The derivative of the (perturbed) pressure pn {(3, (3') with respect 
to the perturbing parameter (3' has the following form as a series in powers 
oft = tanh(/3') 



Proof. We have 



n=0 



rn— 1 V—1 

OO 

rn— 1 
m— 1 

where the sub m indicates that the variable has been fixed to m. It is 
easy to see that 

^(exp(p J^CTi^^ 0-^4 ))m-l 

Hence 

dp,pN{P, /?') = -aEj'^^ , W = Oj{Gv^OyJ , (18) 

1 + " 
according to the usual notations. Now a simple expansion (that we will 
explicitly write in the next lemma) of (1 + tvS)^^ in powers of t yields 

oo 

d0,p^{f3,l3') = -a5]i2"+i((g|„) - (gL+2)) • (19) 

Tl = 
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So the lemma is proven and we have an expression for the right hand side 
of (|16p . if we just multiply the average of the multi-overlaps by the average 

of (j)s. 

Let us now consider the left hand side of (fTB)) . recalling that 0s is a 
function of s replicas, that indices in the spins indicate which factor of the 
product space S'' (which replica) the spin belongs to, and that the energy 
density is assumed to be taken in the first replica. We will henceforth omit 
the prime symbol in all the quenched variables, but still assume that they 
are independent of any other quenched variable implicitly contained in the 
averages. 

Lemma 4 Recalling that w = Lo{ai^aj^), we have 

2.S 2,s 2,s 

a a<b a<b<c 

n T , ^ f(l+l) ,2 2 , g(g+l)Gs + 2) ^3 3 

(1 — Jstw H — 1 w — J — 1 w 

£(sj^l)(s + 2)(£+3) 4 4 _ 

Proof. From the proof of the previous lemma, in particular equations 
pT|) - (fT5)) . and by definition of replica measure, we immediately get 

(.■■v.).-oe "i-'<'''.-^^";;;'/. + -;+<'?.»"'' , ,20) 

that we rewrite as 



(1) J, \ _ „.T1J4 I-'- ]i/ lla=2\ n Jl ' 



(1 + jtwy 

Let us write explicitly the power expansion of the denominator, that we 
omitted in the previous lemma 

1 s(s + 1) , , 



(1 + Jtwy 2! 



.£(i±l)(i+2),3 3 , g(s+l)(s + 2)(5 + 3) ^4 4 

3! w + 41 I w ■■■ . 
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It is also clear that 

s 2,s 2,s 

a— 2 a a<b 

2,s 

I \ ^ „a „b „c „a „h „c j.3 i 
a<b<c 

Gathering all the ingredients completes the proof of the lemma. 

We are now able to compare the two sides of ([16]), and see what the 
self-averaging of the internal energy density in the thermodynamic limit 
brings. 

Equating the expressions computed in the last two lemmas gives 



/'I I 7 \ „a „a J. I \ ^ „a „h „a „h j.2 , \ ^ „a „h „c „a „c j.3 



a a<b a<b<c 

I js—l>s — l 2 s 2 s \] 

(1 - Jstu. + '±±^tW - Jfii±fi±^t3^3 

\<l±2)il+mi±^t^^^ _...)}, (21) 

The equality holds for any smooth function (typical interesting infor- 
mation is obtained for 0s = 1 or (j)s=2n — ^In)' ^'^ that we get equalities 
between expressions involving averages of (squared) overlaps. 

Let us see in detail what information we can get from the lowest orders. 

Denote by E(-|^s) the conditional expectation with respect to the sigma- 
algebra As generated by the overlaps of s replicas. Let us show that the 
usual [5] Ghirlanda-Guerra identities for the overlap hold in our quite gen- 
eral case too (as well known): 

Proposition 1 The Ghirlanda-Guerra relation holds 
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Proof. In the expansion (j'iip . where only the terms of even order survive 
due to the symmetry of the variables J, at the lowest order in t one gets 

2.S 
a 

2,s 



which is precisely what is stated in P^ . (see jlQ), immediately completing 
the proof of the proposition. 

So the usual Ghirlanda-Guerra identities for 2-overlaps are recovered 
(and proven to hold in dilute spin glasses too, for instance). 

At the next order we get instead 

2.S I T\ 

a<b 

2 s 

E' / 2 . \ s{s+ l)(s + 2) 2 J \ 

ilis+l^s) - ^ ^j^ -{qls + l,s+2,s+3<l>s) 

a 

s(s + l) 

+ '—^\ '^{lla,s+l.s+24>s) - s'^{ql^^i,^,^j^(l)s) + {ql,a.b,As) ■ 

a a<b a<b<c 

(23) 

Now consider the four 2-overlaps terms. A simple generalization of the 
usual Ghirlanda-Guerra relations 8 to the case when two replicas are 
added to a previously assigned set of other replicas, tells us that these 
terms cancel out. Let us check that explicitly. 



Corollary 3 Relation i2'J\) implies 

2 2 
E(g2^i,,+2|A) = -— (gL) + ^—uT.1ab ■ (24) 

a<b 

Proof. Let us re-write p2p in the case of s + 1 given replicas 

1 1 

E(9?+i,.+2lA+i) - 7^(9?2) + T^II^L+i ■ 
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Now use 

E{E{-\ As+i)\ As) =E{-\ As) (25) 

to get 

1 1 

E{qUl,s+Ms) = j^iql^) + j^Y.^iqls+Ms) 



' -{ql2) 



s + 1 s 
That is 



2 2 ^^'^ 

which is what we wanted to prove. 

Now with ((22|) and ((24|) in our hands, let us take the three 2-overlap 
terms in the right hand side of (|23p 

^^^(9?+l,.+20s) = s{qj,){cl^s)+Y.(llM 

a<b 

2,s l,s 

-S^l^^L + l'^^) = -■'^J2'^1a,s+l(f's) + S{qls+l<t)s) 
a a 

a b^a a 
2,s l,s 2,s 

a<b a<b a 

The sum of these three terms cleary reduces to {qi2){4>s), which is precisely 
what we find in the left hand side of (|23p . The 2-overlap terms thus cancel 
out from ([23]). We are hence left with a new relation for 4-overlaps: 

£(s + l)(i+2) 2 + 

^] \qi,s + l,s+2,s+3'Ps/ 21 / ,\qi.,a.,s+l,s+2'Ps/ 

a 

2,s 2,s 

+ ■'^^ill,a,b,s+l'l^o) ^ ill234){'l^s) + J2 '^ll,a,b,As) , 
a<b a<b<c 
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and the proof of Theorem [J] is now complete. 

We report for sake of completeness the general expression of the generic 
order in the power series expansion (|2ip . From the explicit calculation in 
Lemma HI we get 

{<in){'Ps)-{qL+2){'i>s) = 



2n s-1 2,s 

E 

m— 2n — s+1 a\<---<ai 



271+1 s-1 2,s / I I 1\ 

\- h™(^^ + ^+ jE[^™i](0,44<...<v;;...4')]'52„.™+;-i 



m— 2n — s+2 ai<---<a 



which becomes 

2riAs-l 2,s /o I ; I 1 

2 \ /„2 ^ N2«-(/2n + s-/ + l 



(92„)(0.)-('?2„+2)('/'.)= E E H"'^ 'I 2n-l 

111 2 2 \ _ 2rt — / + S + 2 2 2 \1 

[\H>s(lai---ai1s+l---s+2n-ll 2n — I + 1 ^'''^'^l"! ' ' '"i ■«+2"-'+l ' ' ' 

(26) 

In both the expressions above the term for Z = is understood to be one. 

The right hand side of ((26|) . due to the presence of 1 + Jt~^a in the right 
hand side of (|2ip - along with the symmetry of J, makes the expansion 
somewhat recursive. This means that at each order we find some terms 
already found in the previous order. More precisely, we claim without 
proving that at each 2n-th order of the expansion, all the terms involving 
2m-overlaps with 2m < 2n cancel out thanks to a repeated use of ([^5]) with 
the relations coming from the lower orders. Hence from the 2rt-th order we 
get new relations involving 2n + 2-overlaps only. This is what we explicitly 
verified only for 4-overlaps in the previous pages. More explicitly, if we 
re- write the difference in the right hand side of ((26| as 

we have 

{Q2n){4's) = C2n , ('72«+2)(0s) = rf2n+2 , C2„ = d2n • 
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So that the final formula becomes 



2nAs-l 2,s 




2n + s -1 + 1 
2n - I 




'?s+l---i5+2n-i'^s) ■ 



Z=0 ai<-<a; 



4.1 generalization to smooth functions of multi-overlaps 

Just like for the family of identities discussed in the previous section, we 
started our analysis with the most natural quantity: the energy of our 
model with 2-spin interactions. And so we got again some relations for 
the squared multi-overlaps. But we already know how to generalize these 
formulas to smooth functions of the overlaps. We can consider p-spin in- 
teractions, and the procedure would provide us with the same relations for 
the p-th power of the overlaps. Then, as already explained, we can take a 
convergent sum over all integer p of p-spin Hamiltonians, and consider the 
self-averaging of the desired one among them. The perturbed Hamiltonian 



where J2p I'^pP — J2p l^pP — 1; the notation for all the quenched variables 
is the usual one, and {\p} are the independent perturbing real parameters. 
As a side remark, we just point out that (like in fS]), in the case of this secon 
family of identities it is not necessary to consider a Hamiltonian consisting 
of the sum of all possible p-spin Hamiltonians: only the perturbation must 
be so. 

Concluding remarks 

Notice that while we derived our identities having as reference diluted spin 
glasses, all that matters in the derivation are the properties of the perturb- 
ing Hamiltonian, and they are therefore generically valid. 



IS agam 




p 
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The Ghirlanda-Guerra identities for the overlap have been useful to 
prove non trivial properties of mean-field spin glasses. For instance Tala- 
grand could prove that for all models where the identities are valid, the 
support of the overlap probability function has positive support. This pos- 
itivity property is important as it enters in the the Guerra free-energy 
bounds in spin system without spin reversal symmetry. The corresponding 
bounds for diluted systems involve all possible multioverlap. It has been 
proved [7] that the cavity method provides free-enegy lower bounds for 
the random K-SAT problem for even K. Due to the difficulty of proving 
the positivity of the multioverlap, the bound does not apply to the odd K 
case. Proving the positivity would therefore allow to extend the bound to 
this case and in particular to the symbolic case K=3. Unfortunately the 
derivation of Talagrand for the overlap does not extend immediately to the 
multi-overlap case. We believe however that the self-averaging identity will 
be useful in the mathematical analysis of diluted spin models. 
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